Analysis of Gesture and Action in Technical Talks for Video Indexing
نویسندگان
چکیده
111 thi.) puper, we present un uutomutic. system fi,r U I I ulyzing and unnotuting video sequences of trchnicrd tulks. Our method uses U robust motion estiniution tec,hnique tci detect k e ~ frunzes und segment the video sequence into subsequences cmtuining a single overhead slide. The subsequences ure stabilized to remove motion that o m m when the speukeradjusts their slides. Any chunges remuining between frunzes in the stubilized sequencxs muy be due to speuker gestures such us pointing or writing and we use uc-tive c~intour.~ to automaticdl~ truck these potential gestures. Given the construined domuin we dejine U simple “voc-ubu1un.” cguctions which ~ ’ u n eusily be recognized bused on the active c~intour shupe and motion. The recognized actions provide U rich unnotution ofthe sequence that cun be used to ucces.s a condensed version of the tulk from U web puge.
منابع مشابه
Neural Network Performance Analysis for Real Time Hand Gesture Tracking Based on Hu Moment and Hybrid Features
This paper presents a comparison study between the multilayer perceptron (MLP) and radial basis function (RBF) neural networks with supervised learning and back propagation algorithm to track hand gestures. Both networks have two output classes which are hand and face. Skin is detected by a regional based algorithm in the image, and then networks are applied on video sequences frame by frame in...
متن کاملHand Gesture Recognition from RGB-D Data using 2D and 3D Convolutional Neural Networks: a comparative study
Despite considerable enhances in recognizing hand gestures from still images, there are still many challenges in the classification of hand gestures in videos. The latter comes with more challenges, including higher computational complexity and arduous task of representing temporal features. Hand movement dynamics, represented by temporal features, have to be extracted by analyzing the total fr...
متن کاملAction Change Detection in Video Based on HOG
Background and Objectives: Action recognition, as the processes of labeling an unknown action of a query video, is a challenging problem, due to the event complexity, variations in imaging conditions, and intra- and inter-individual action-variability. A number of solutions proposed to solve action recognition problem. Many of these frameworks suppose that each video sequence includes only one ...
متن کاملSummarization of Video - taped Presentations : Automatic Analysis of Motion
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. XX, NO. Y, SEPTEMBER 1998 Summarization of Video-taped Presentations: Automatic Analysis of Motion and Gesture Shanon X. Ju, Michael J. Black, Scott Minneman, Don Kimber Abstract| This paper presents an automatic system for analyzing and annotating video sequences of technical talks. Our method uses a robust motion estimation ...
متن کاملCompressed Domain Scene Change Detection Based on Transform Units Distribution in High Efficiency Video Coding Standard
Scene change detection plays an important role in a number of video applications, including video indexing, searching, browsing, semantic features extraction, and, in general, pre-processing and post-processing operations. Several scene change detection methods have been proposed in different coding standards. Most of them use fixed thresholds for the similarity metrics to determine if there wa...
متن کامل